-
Notifications
You must be signed in to change notification settings - Fork 71
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Use CreatePipeline instead of PipelineSpec for resources.Pipeline struct #2287
Conversation
Is it possible to use new API stubbing functionality (example: https://github.com/databricks/cli/blob/main/acceptance/workspace/jobs/create/test.toml#L6) to add a couple of acceptance tests:
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I agree it would be nice to drop dry_run
and allow_duplicate_names
from the schema, but we have examples of other resources with properties we don't intend to support so we can deal with that separately.
Just so that we can omit these properties later, could you make sure that they're not forwarded to TF as part of tfdyn? That way we can remove them later (when we also take a closer look at properties included for other resources) and not regress anything.
340103d
to
8245da8
Compare
@denik Once support for bundle deploy in acceptance test lands + TF change for |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good to me other than the issue of losing documentation.
// will be exposed which is expected and test will need to be updated. | ||
RunAs: &pipelines.RunAs{ | ||
UserName: "foo@bar.com", | ||
}, |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
So this PR is a no-op until the TF bump happens?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Yes, it just uses a new struct and make sure we don't have schema changes for now
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good!
Changes
CreatePipeline
is a more complete structure (superset of PipelineSpec one) which enables support of additional fields such asrun_as
andallow_duplicate_names
in DABs configuration. Note: these fields are subject to support in TF in order to correctly work.Tests
Existing tests pass + no fields are removed from JSON schema